Neural Network Panning: Screening the Optimal Sparse Network Before Training
نویسندگان
چکیده
Pruning on neural networks before training not only compresses the original models, but also accelerates network phase, which has substantial application value. The current work focuses fine-grained pruning, uses metrics to calculate weight scores for screening, and extends from initial single-order pruning iterative pruning. Through these works, we argue that can be summarized as an expressive force transfer process of weights, where reserved weights will take removed ones purpose maintaining performance networks. In order achieve optimal scheduling, propose a scheme called Neural Network Panning guides through multi-index multi-process steps, designs kind panning agent based reinforcement learning automate processes. Experimental results show performs better than various available methods. Our code is made public at: https://github.com/kangxiatao/RLPanning.
منابع مشابه
analysis of power in the network society
اندیشمندان و صاحب نظران علوم اجتماعی بر این باورند که مرحله تازه ای در تاریخ جوامع بشری اغاز شده است. ویژگیهای این جامعه نو را می توان پدیده هایی از جمله اقتصاد اطلاعاتی جهانی ، هندسه متغیر شبکه ای، فرهنگ مجاز واقعی ، توسعه حیرت انگیز فناوری های دیجیتال، خدمات پیوسته و نیز فشردگی زمان و مکان برشمرد. از سوی دیگر قدرت به عنوان موضوع اصلی علم سیاست جایگاه مهمی در روابط انسانی دارد، قدرت و بازتولید...
15 صفحه اولElectrical Load Manageability Factor analyses by Artificial Neural Network Training
On typical medium voltage feeder, Load side management means power energy consumption controlling at connected loads. Each load has various amount of reaction to essential parameters variation that collection of these reactions is mentioned feeder behavior to each parameter variation. Temperature, humidity, and energy pricing variation or major event happening and power utility announcing to th...
متن کاملA conjugate gradient based method for Decision Neural Network training
Decision Neural Network is a new approach for solving multi-objective decision-making problems based on artificial neural networks. Using inaccurate evaluation data, network training has improved and the number of educational data sets has decreased. The available training method is based on the gradient decent method (BP). One of its limitations is related to its convergence speed. Therefore,...
متن کاملPeephole: Predicting Network Performance Before Training
The quest for performant networks has been a significant force that drives the advancements of deep learning in recent years. While rewarding, improving network design has never been an easy journey. The large design space combined with the tremendous cost required for network training poses a major obstacle to this endeavor. In this work, we propose a new approach to this problem, namely, pred...
متن کاملIncremental Convolutional Neural Network Training
Experimenting novel ideas on deep convolutional neural networks (DCNNs) with big datasets is hampered by the fact that network training requires huge computational resources in the terms of CPU and GPU power and hours. One option is to downscale the problem, e.g., less classes and less samples, but this is undesirable with DCNNs whose performance is largely data-dependent. In this work, we take...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Lecture Notes in Computer Science
سال: 2023
ISSN: ['1611-3349', '0302-9743']
DOI: https://doi.org/10.1007/978-3-031-26319-4_36